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KINETIC THEORY AND THE KAC MASTER EQUATION 

ERIC CARLEN \ MARIA C. CARVALHO 2 , AND MICHAEL LOSS 3 



Abstract 

This article reviews recent work on the Kac master equation and its low dimensional coun- 
pg ■ terpart, the Kac equation. 

H-s 

1. Introduction 

As a phenomenological equation, the Boltzmann equation is extremely successful. It is now 
synonymous with kinetic theory, i.e., the description of a large number of colliding particles. 
Q-e For colliding hard spheres of radius a in a box of volume V, it reads 

-5 d . _ . . a 2 



- Wt f + v-W x f + F-W v f = V2 JdwJ^ de| (w-v)- e\ 

[f(x,-r[(v + w) + b — w|e],t)/(a:, -[(v + w) - \v-w\e],t) - f(x,v,t)f(x,w,t)] 

This equation together with the initial conditions f(x,v,0) = fo(x,v) is a non-linear ini- 
tial value problem. The function f(x,v,t) is a probability density giving the probability 
f(x,v,t)dxdv for a particle to have its position and velocity in the cube dxdv centered at 
x, v). In many ways, this type of equation can be used to describe any process that evolves 
under streaming and collisions, which is one of the reasons why this equation is so useful in 
many different circumstances. Its foundation as the equation of kinetic theory is, however, 
mysterious. Up to this day, there is no satisfactory derivation of the Boltzmann equation 
starting from a classical Hamiltonian many body system, notwithstanding the work of Lan- 
ford [1I7L [16], |15[ . The problem is that the derivation works only up to the first average collision 



time. Even in this case, however, the derivation is a mathematical tour de force. Likewise, 
Diner and Pulvirenti [ITT], |T2[ consider the case of a gas jet entering a vacuum in the limit 
where the number of particles tends to infinity but the particle density is small. Since the gas 
is expanding in the vacuum the number of collision among the molecules is finite. This allows 
them to obtain a result for all times. 

An attractive feature of the Boltzmann equation is that it allows one to talk in precise 
terms what is meant by approach to equilibrium. An equilibrium is a stationary solution 
of the Boltzmann equation. In the absence of an external force F, it is a straightforward 
computation to determine this function to be a global Maxwellian distribution. There is the 
strong expectation that starting with any initial condition the solution should approach a 



E. C. was supported in part by NSF grand DMS-0901632. 
M. C. was supported by FCT grant PTDC/MAT/100983/2008. 
M. L. was supported in part by NSF grant DMS-0901304. 

1 



2 CARLEN, CARVALHO, AND LOSS 

global Maxwell distribution for large times. Considerable research has been done on proving 
return to equilibrium, i.e., studying the long-time behavior of this equation. One of the main 
tools in this endeavor, the H functional or entropy, has been introduced by Boltzmann himself. 
Boltzmann proved that j f log fdxdv decreases with time. A quantitative version of this result 
has been obtained by Desvilletes and Villani in ||. It is, however, a conditional theorem; their 
result holds for smooth global solutions of the Boltzmann equation. It is unknown whether 
such solutions exist. The only result in this direction is the one of DiPerna-Lions |7], [5] . These 
global solutions, however, are weak and not amenable to the analysis in ||. 

If one contemplates a bit the times scales between the validity of the Boltzmann equation 
proved up to now and the desire to understand return to equilibrium, one may wonder what 
the connection of 'return to equilibrium' and microscopic physics might be. In any case it 
points to a huge gap in our understanding of the long time evolution of many particle systems. 

Since the Boltzmann equation is, for want of a better word, 'paradigmatic' for describing 
systems consisting of a large number of interacting agents in a probabilistic way, one might 
ask for a 'derivation', not based on mechanical principles, but based on simple and transparent 
probabilistic assumptions. This is the path taken by Kac in 1956 |14|. A number of simpli- 



fications have to be made. The first is to restrict one's attention to a spatially homogeneous 
gas, i.e., where the distribution function does not depend on the position, i.e., one considers 
only the collision terms. This restriction is reasonable since one expects that collisions act on 
a different time scale than the streaming. In this case the Boltzmann equation takes the form, 
again written for hard spheres, 

,2 



P = V I dw L del{w 



x [f(^l(v + w) + \v-w\e],t)f(^[(v + w)-\v-w\e],t)-f(v,t)f(w,t)] . (1) 

Thus, one visualizes the times evolution of the full Boltzmann equation as a sequence of col- 
lisions interrupted by streaming. This picture is used in the work of Desvilletes and Villani 
mentioned above and a large part of their work goes into the analysis of the spatially homoge- 
neous Boltzmann equation. Indeed, it presents substantial difficulties concerning the question 
of approach to equilibrium and as a first step a further simplification can be made by con- 
sidering Maxwellian molecules in which the collision rate does not depend on the momentum 
transfer during the collision but just on the angles. The evolution equation then takes the 
form 

d -f= l - [dwf deB^ W - v) 



dt t J J §2 \ | (w — v 

1 l 

^-[{v + w) + \v-w\e],t)f(- 



[f(h(v + w) + \v- w\e],t)f{h(v + w)- \v - w\e],t) - f(v, t)f(w, t)] (2) 



[ B(we)de = l [ B{ 
Js 2 l J-\ 



x)dx 



The form of B is not important but one should remark that for the case where the force law 
is a repulsive 1/r 5 , the scattering is indeed independent of the momentum transfer and the 
function B can be expressed in terms of an elliptic function. This was discovered by Maxwell 



19| . Kac simplified the model further by reducing the problem to one dimensional collisions. 
Two one dimensional colliding particles either go through each other without changing the 
momenta, or exchange the momenta. In order not to limit the collision outcomes too much 
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one drops the momentum conservation and only retains the energy conservation and considers 
the Kac equation 

^f = zf Mp(0) J MfV, t)f(w', t) - f(v, t)f(w, t)] (3) 

where 

v' = v cos 9 — w sin 9 , w' = v sin 9 + w cos 9 

are the 'post collisional' velocities and where p(9)d9 is a probability measure satisfying 

p{-9) = P {9) . 

This condition is known as local reversibility since the transitions (v , w) — > (V, w') and 
(v',w') — > (v,w) are equally likely. A particularly simple choice is 

P( & ) = ^ • 

Zn 

Among all the specializations done so far the really serious ones are the first two, namely 
passing to the spatially homogeneous case and restricting to Maxwellian Molecules. Most of 
the results that hold for fl3|) can be extended to the (0). This non-linear evolution equation 



can be derived from a master equation as Kac has shown in [|1J . 

The aim of this article is to describe some of the recent results concerning the connections 
between the equation (|3]) and the Kac Master equation. Most of these results have been 
obtained in the last ten years or so. If simple proofs are available they will be presented, 
otherwise the reader is referred to the literature. In the next section we derive the linear Kac 
master equation and formulate the question of approach to equilibrium in this new context. 
In the third section we the connection between the Kac Master equation and Kac's equation 
(H) will be explained in terms of propagation of chaos. In the fourth section we calculate the 
gap for the master equation and in the fifth section we talk about approach to equilibrium in 
the sense of entropy. We end the paper with a number of open problems. 

2. The Kac Master Equation 

Kac's starting point is a random walk in velocity space. Consider N particles moving on 
the line. As mentioned before, we shall restrict ourselves to the case where the gas is spatially 
homogeneous. We denote by 

v = (v 1 ,v 2 ,--- ,Vn) 
the velocity vector, i.e., the coordinate t>j is the velocity of the particle carrying the label i. 
The total kinetic energy of this system is 



N 

2 



msr- 2 



_ in v — -\ 



i=l 

where we assume that all particles have the same mass m. We shall set m = 2. For the 
collision law we shall assume that 

(vi,Vj) — > (v* (9) , v* (9)) = (cos 9vi — sin 9vj, sin 9vi + cos 9vj) 

where the stared quantities are the post collisional velocities. Clearly, the kinetic energy 
is preserved. Hence the state space of the system is described by points v on the sphere 
E> N ~ 1 (vE). In physical collisions the momentum should be conserved too, however, this leads 
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to exactly two outcomes: Either the particles go through each other or exchange velocities. 
Such a collision process would not lead to an ergodic Markov transition operator. 
The "Kac walk" can now be described as follows: 

(1) Randomly pick a pair (i,j) of distinct indices in {1, ...,JV} uniformly among all such 
pairs. The particles with labels i and j will collide. 

(2) Randomly pick a 'scattering angle' 9 with probability p(8)d6 on [0, 2tt). 

(3) Update the velocities by a rotation, i.e., 

(vi,Vj) — > {y* (9) , v* (#)) = (cos 9vi — sin 9vj, sin 9vi + cos 9vj) (4) 

Repeating this process yields a random walk on S N ~ 1 (\/E). 

It is fairly straightforward to construct a Markov transition operator. Let Vj be the velocities 
of the particles after the j-th collision and let <p '■ ^ N ~ l (vE) ->Rbea continous function. 
Define the Markov transition operator Qn by 

Qn4>(v) = E{(f>(v j+1 )\vj = v} 

where the expectation is with respect to the probabilities specified above, i.e. 

qn<p(v) = -L j2 p^m (5) 

V 2 ) i<j 

where 

P hJ <P(v) = f p(9)<f)(R^ e v)d9 (6) 

J — IT 

and 

R^ e v = (vu ■ ■ -,v*(9), . . .,v*(9), ...,v N ). (7) 

Let Fo be the initial probability distribution for the velocities v. The probability distribution 
Fi of the velocities after one collision can be computed via 

_ 0(#)Fi(#)d<r (JV) = / _ E{0(iTi)I^o = v}F (v)da w 

i.e., 

/ _ ^F^da^ = f _ Q N( j>(v)F (v)da^ (8) 

J§ n - 1 (Ve) Js n - 1 (Ve) 

Here a^ N ' is the uniform normalized measure on S N ~ 1 (y/E). Since p{—9) = p(9), the linear 
operator Qn is selfadjoint on L 2 (Bi N ~ 1 (vE), da^) and since (f$D holds for all continuous 
functions 0, we have that 

Fi(v) = Q N F (v) . 

Hence Fj the probability distribution after j collisions is given by 

^ = Q%F . (9) 

So far, time has not been mentioned, and here we need some further assumptions. It is 
reasonable to assume that the velocitiy distribution at time t + dt should only depend on the 
distribution at time t and not on what happened in the past, i.e., we construct a continuous 
Markov process. Thus, we assume that between time t and t + dt the probability that a 
collision occurs is 

\Q N F(v,t)dt + o(dt) , 
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where A is a constant. We assume that the probability that multiple collisions occur in the 
time interval [t, t + dt] is negligible. Thus, since there are N particles colliding independently, 
we have, for small time increments, 

F(v, t + dt)= N\Q N F(v, t)dt + (1 - N\F(v, t))dt + o(dt) , 

or 

F(v, t + dt) - F(v, dt) = NX [Q N F(v, t)dt - F(v, t)] dt + o(dt) . 
Passing to the limit we find the Kac Master Equation 

j t F(v,t) = \N[Q N -I]F(v,t) 

F(v,0) = F (v) 

where F is the initial probability distribution. 

The initial value problem is now solved by the convergent power series 

F(v,t) = e^»-^F (v) = J2 ~ ^-Q'nMv) ■ 

k=0 

Since Qn is an averaging operator, Q^l = 1 and this implies that F(v,t) is a probability 
distribution for all times t. A simple computation shows that 

irEf Pi ) [ \nRi,j,ov) - F(v)fda^ 

= 2(\\F\\l-(F,Q N F)) , 

where we denote the inner product on L 2 (S Ar_1 (-\AE) by (F, G). It follows that Qn and hence 
e Aiv(Qjv-/)t j g ergodic, i.e., QnF = F only if F — 1, in particular Qtv < 1- An immediate 
consequence of this is that F(-,t) converges to the function 1 as time tends to infinity. More 
precisely, a simple application of the spectral theorem leads to 

Lemma 2.1. Assume that < F E L 2 (E> N '\^/E),da iN) ) and that 

F(v)da {N) = 1 . 



Then we have approach to equilibrium in L 2 , i.e., 

\\e XN ^-^F -l\\ 2 ^0 

as t — > 00. 

An issue we explore later is to find rates for the approach to equilibrium. For large systems 
it is generally observed that the rate of equilibration is independent of the size of the system, 
i.e., N. Thus, the challenge is to find an estimate on the relaxation rate that is uniform in 
the number of particles. 

From now on we will adopt the following conventions. We shall henceforth assume that the 
function F (v) and hence F(v,t) is symmetric in the particle labels. We set A = 1. Finally, 
since the energy is extensive we can set E = N. 

With these choices, the Kac master equation reads 

pm = -cf do 
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with the initial condition 

F{v,0)=F {v), (11) 

where 

C = N(I- Q N ) , (12) 

and Q N is given by (|5|), (g) and (|7|). 

3. Propagation of chaos 

Note that the velocities, viewed as random variables with respect to any probability measure 
on S^ -1 are not independent since 

N 

i=i 
However, as N gets large one would expect that this dependency gets weaker. The notion of 
chaos makes this precise. It will be convenient to define it in the language of measure theory. 
To start we define the marginal measure. Let fj,^ be a probability measure on E> N ~ 1 (yN). 
Fix k < N and pick any Borel id'. Define 

M k (^)[A}=^ N \{( Vl ,...,v k )eA}}, 

in other words, we integrate the measure ^ N > over the sphere but restricting the variables 
Vi, . . . ,Vk to remain in the set A. 



Definition 3.1 (Chaos). Let \x be a given Borel probability measure on R. A sequence of 
probability measures {^ N ^} ( ^ =2 is called /i -chaotic if each fj,( N ' is symmetric under permu- 
tations of the particle labels and for each positive integer k the k-marginal measure M k (fJ>( N ^) 
converges to n® k , i.e., for every bounded, continuous test function x( v ii ■ ■ ■ i v k) we have that 

x(vi, . . . ,Wfc)d/i (7V) (fi, . . . ,v N ) ->■ / x( v h ■ ■ ■ > v k)dfj,(vi) - ■ ■ dfj,(v k ) 



An illuminating example is given by the Mehler limit ||20[ . In this case the measure /i^ N ' is 
given by the normalized uniform surface measure which is symmetric. Further, 

x(vi,...,v k )da {N) (vi,...,v N ) 

7V — fc— 9 

1 x(v i,..., v k ) 1 -rr^l dv t ---dv k 



-> (2tt) 2 / x(Vi,...,v k )e 2 dv 1 ---dv k 
as N — y oo. For notational convenience we set 

7 « = (27r)-fe-% i . 

Let us remark that Kac, in his 1956 paper talked about sequences that have the Boltzmann 
property, instead of chaotic sequences. In some ways this is a better name and the next 
theorem makes that clear. 
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Theorem 3.2 (Propagation of Chaos, Kac 1956). Let {F a^} be a f (v)dv -chaotic se- 
quence and denote by {F t V^} the sequence of measures where F t is the solution of the 
master equation, i.e., F t = e N ^ N ~ I ^ t Fo for some fixed t. Then, {FJ; a^} is a f(v,t)dv- 
chaotic sequence and f(v,t) is a solution of the initial value problem 

d 



di f = 2J d6p(6)J dw[f(v*(9,t)f(w*(9),t) - f(v,t)f(w,t)] 

with f(v,0) = fo(v), i.e., it is a solution of the Kac equation. Recall that v* (9) andw*(9) are 
given by (gp. 



For the proof we refer the reader to the original paper of Kac [jT4 . 

The above theorem immediately raises the question whether any measure of the form f{v)dv 
appears as the marginal of a chaotic sequence. Or, more precisely, let / be a probability density 
on R with 



vf(v)dv = , / v z f{v)dv = 1 . 

Is there an f(v)dv chaotic sequence {F^a^} ? It is natural to consider f® N which is a 
function on M N and to restrict it to the sphere § 7V_1 (viV) and then to control the fluctuations 
of ^2j =1 Vj with respect to the measure f® N dv± ■ ■ -dvN- Since the v\ can be considered as 
independent random variables with respect to f® N , and since the fluctuations are controlled 
by the second moment of the random variables, this amounts to an assumption on the fourth 
moment of the function f(v). In fact we have the following theorem J3]. 

Theorem 3.3 (CCLRV). Let f be a probability density on R satisfying 

J f(v)v 2 dv = 1 , / f(v)v 4 dv < oo , / G L c 

and let (J,(dv) = f{y)dv. Then {[/^ (glJV ]§iv-i( v ^v)} is \i -chaotic. 

The core of the argument is the following central limit theorem. Set 



(v 2 - l) 2 f{v)dv 



and 



Zn(M:= I (£] daf) 



"-!(r) \7 



Theorem 3.4. Assume that 



J v f(v)dv = , / v 2 f{v)dv = 1 , / f(v)v 4 dv < oo , / G L P (R) 

</R Jr Jr 

for some p > 1 . Then 



Z N (f,VN) = jrQ- + o{l)) 



as N — >■ oo. 
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4. Kac's conjecture 

Recall that the solution of the Kac Master equation is formally given by e~ CNt where 
Cn '■= N(I — Qn)- One measure of the rate of approach to equilibrium is given by the gap of 
Cm- Define the gap 

A N = mf{(F,£ N F):F±l, \\F\\ 2 = 1} . 

If / is any probability distribution that is in L 2 ('B N ~ 1 (\/N), it follows from the spectral 
theorem that 

||e-^7-l|| 2 <e- A -1/-l|| 2 . (13) 

The important question is whether the gap persists as N — > oo. In his 1956 paper Kac 
conjectured that 

A N > c> 

where c is independent on N. After some attempts in || this conjecture was proved by E. 
Jeanvresse |1^] using H.-T. Yau's Martingale method. An explicit expression for the gap was 
computed in |]. This result was rediscovered in |ll|. The following theorem was proved in 
(see also for more general results). 

Theorem 4.1 (CCL). Set p{6) = ±. We have that 

N 2N-1 
and the gap eigenfunction, unique up to a multiplicative constant, is given by 

A / 4 3iV 

F ^ = ^-(ivT2) 

It is instructive to compare this result with the gap of the linearized Boltzmann equation. 
The first marginal of F An can be easily computed and one obtains 

lim M t F AN (v) = (27r)- 1/2 e-^(v 4 - Qv 2 + 3) = j(v)HJv) . 

N— >oo 

To linearize the Kac operator, we set / = 7(f) (1 + eh) and obtain 

1 r n /*oo 

— / d6 dwy (w) [h(cos 9v — sin 8 w) + h(sin 8v + cos 9 w) — h(v) — h(w)] 

n J-tt J-00 

The fourth Hermite polynomial is an eigenfunction with eigenvalue — \ which is the gap of 
the linearized Kac operator. In fact it is easy to see that all eigenfunctions are given by 
the Hermite polynomials. (Mc Kean 66 pl |, Griinbaum 1972 [K|). Thus, as iV — > 00 all 
the information one gets from the gap of the Master equation is the gap of the linearized 
Boltzmann equation. It is likewise easy to see that all the eigenfunctions of the the operator 
£ are given by spherical harmonics. The tricky part, however, is to decide which among those 
is the gap eigenfunction. 

The proof of the above theorem is not difficult and the method has been useful in a variety 
of circumstances which gives us the reason to reproduce it here. In a first step one computes 

liV + 2 

£nF An - - N _ - f An . 
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Hence, An < |^rf • The real issue is to prove the reverse inequality. We make an induction 
argument in the number of particles. For N = 2 

C 2 = 2(I-Q 2 ) 

and Q2 is a one dimensional projection. Hence 

A 2 = 2. 

Write 

JV(J - Q N ) = £(J ~ Qn-i) 

fe=i 

where 

1 

Qn-1-F = (N-l\ z_^ "ijF ' 
\ 2 / i<j, i,jy^k 

i.e., Q fc is just the operator acting on the whole space with the interaction with particle k 
being absent. Thus, for any F _L 1 we have 

N 



(F, N(I - Q N )F) = £<F, (/ - Q^F) 



fe=i 



and we try to use the gap for iV — 1 particles, Ajv-i- Note that for fixed Vk, the function 
F(-,Vk) is not perpendicular to the constant function on § JV_2 (y / iV — vt). Thus, write F = 
(F — PkF) + PkF where PkF(vk) is the unique function with 

/ _ <f>(v k )F(v)daW = f __ <f>(v k )P k F(v k )daW 

for all test functions <f>(vk), i.e., 

PkF(v k ) = [ F(v)da( N -V 

J§^-2( V /JV^|) 

Pfc, as an operator on L 2 (Ei N ~ 1 (vN)), is a selfadjoint projection. Hence 



iV 



(F,N(I-Q N )F) = J2((F-P k F),(I-Q k N _ l )(F-P k F)) 



fe=i 



(14) 



since Q k N _ x PkF = PkF. By the induction assumption we know that 

((F-P fc F),(iV-l)(/-Q^ 1 )(F-P fc F))>A w _ 1 ||(F-P fe F)|| 2 = A w _ 1 [||F|| 2 -(F,P fc F)] 
and hence 

(p,iv(/-g w )P)>^ T A Ar _ 1 [||P|| 2 -(P,pp)] 

where 

fe=i 
Setting 

/xjv = sup{(P, PP) : P JL 1, ||P|| = 1} 



1 N 
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we find that 

N 
A W > - Ajv-i(1 - hn) ■ 

Thus, we need to analyze the operator P. To this end we set 

N 
1 - 
Kk{V) = v k 

A 

fc=l 

and notice that for /xjv 7^ 0, F is a sum of functions depending only on one variable, i.e., if we 
set P}~F = h o -K k 

1 N 
F = — Y^ h o n k 

Note that h does not depend on k since F is symmetric. Also note that 

(/lO7T 1 ,l) = (/lO7T 1 ,(7r 1 ) 2 )=0 

since 

N 

J2(- k ) 2 = \v\ 2 = N 
fc=i 
Now 

1 ^ 
-^P 1 P fc F = /i JV P 1 F, 

fe=i 
or 

1 JV- 1 

— Al o 7Ti H JI—P1P2F = IX N h o 7Ti , 

where 

P X P 2 F =: (X/i) o tti 

Hence, if we denote by kat the largest eigenvalue of K subject to the conditions 

(/lO7T 1 ,l) = (/lO7T 1 ,(7r 1 ) 2 )=0 

then 



1 JV-1 

fl>N — 

and 



fiN ~N + ^T KN 



N 

Aat > - Ajv-l(l - yUjv) = Ajv-l(l - K N ) 

Thus, we have reduced the whole problem to the calculation of the spectrum of the operator 
K, which is a relatively simple task. If h is a function on the interval [— vN, y/N] then hon 2 as 
a function on the sphere is constant on the circles of latitude perpendicular to the 2-direction. 
Now, averaging this function over all rotations that fix the 1-direction delivers a new function 
which we denote by (Kh) o -k 1 . Thus, we have as a quadratic form 

(h O 7Ti, (Kh) O 7Ti) — (ho TTih O H 2 ) 

i.e., the K -operator measures the correlation of hom and ho^ 2 on the sphere. More generally, 
pick any two unit vectors e\ , e 2 and consider the form 

(g(v- e x )h(v- e 2 )) = (g(v ■ ei)(K t h)(v ■ ei)) 
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where t — e± ■ e*2- A straightforward calculation yields 

{K t h){v) = {-^ / h{vt + VN^VT^s){l - s 2 )^ds . 



l N - 2 \ ./_j 



In our situation t = and hence we obtain the explicit expression 



;JV— 31 /•! 



(^)(«) = j^rf J i MViV^^ S )(l - s 2 )^d S . 

The following lemma is proved in [|TJ . 

Lemma 4.2. The eigenf unctions of K are polynomials p n (v) with eigenvalues a n . The eigen- 
values vanish for n odd and 

jJV-31 rit 



a 2m = (-l) fe i^ / [cos6} 2m [sm6} N - 3 d6 . 



'0 

In particular 

\ot2m\ is decreasing in m. 

The second largest eigenvalue of P is therefore 



Since A2 = 2 we easily find 



1- 



N 2 -l 

1N + 2 



An -2N-1" 
which proves the theorem. 

It is somewhat gratifying that the gap can be computed in other circumstances too. An 
interesting particular case is where the distribution of the scattering angle is not uniform and 
given by the density p(9). It can be easily verified that F& N is always an eigenfunction of Cn 
with eigenvalue 

_i (iy + 2) ^ 

where 



T 2 = 2 / (1 - cos(40))p(0)d0 . 

J — IT 

However, T^ is not the gap in general, since for iV = 2 we may have 

(1 - cos(fc0))p(0)d0 < r 2 

-71 

Our induction scheme applied naively, leads to 

A 2 N + 2 

which proves Kac's conjecture in this case too. We can do better, however. 
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Theorem 4.3 (CCL). Assume that 

A 2 > 0.45r 2 

then for all N sufficiently large An = ^n and F& N is the corresponding eigenf unction. 

For the proof, which is a bit trickier, we refer the reader to the paper || 

The Kac Master equation for a spatially homogeneous gas of particles in three dimensional 

space is analogous to the one dimensional case. Recall that the collision law between two 

particles is given by 

v *( w ) = 2^ Vi + v i"> + \ Vi ~ v i\ w \ 

where w6§ 2 . These collision preserves now the energy sphere and the momentum plane, i.e., 
the quantities 

N N 

J2\ y j\ 2 > and ^2 v j 

3=1 3=1 

are preserved. As before, we fix the total energy to be N and, in addition, we fix the total 
momentum to be zero. The Kac operator is obtained by replacing P it j in Qn by 

P M F= f F( Vl , ..., v*(w), ..., v*(w), ..., v N )B ( ^ ~ Vj ] .w]dw. 



J$* \ \ v i ~ v j\ / 

It is a selfadjoint operator on the space L 2 (M,hn) where M is the intersection of the energy 
sphere with the momentum plane. The measure /j,n is the Euclidean measure on M. 3N restricted 
to M. 

It was shown 0] for the case where B is constant, that A^ > c > 0, c independent of N . 
We can, however, say much more. Set 

Bi = - I xB(x)dx and B 2 — - x 2 B(x)dx 

and recall that § /_, B(x)dx = 1. The following two theorems were proved in 0] 
Theorem 4.4 (CGL). Suppose that B 2 > £>i and that 

A 2 >y(l-5 2 ). 
Then for all N > 3 

A N = ^(l - B 2 ) . 
Moreover, the eigenspace is three dimensional, and is spanned by the functions 

N 
3=1 
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Theorem 4.5 (CGL). Suppose that A 2 = 2(1 - B ± ). Then for all N > 7, 

A„ = min | (1 - B x ), -j— y(l " B 2 

Moreover, if B 2 > B x , the eigenspace is three dimensional, and is spanned by the functions 

N 

*(#) = !>/< , " = 1,2,3 
j=i 
If B 2 < B\, the eigenspace is spanned by the functions of the form 

\ v i\ 2 ~ \ v j\ 2 an d vf — v" , a = 1,2,3 
for all i < j . 

The overall strategy of the proof is the same as in the case for one-dimensional collisions, 
i.e., the problem is reduced to the study of a low dimensional operator K. The eigenvalues, 
however, do not have any obvious monotonicity properties and the computations are much 
more complicated. Detailed estimates on Jacobi polynomials are used. We refer the interested 
reader to ||. 

The computations of the gaps for the various models can be considered a success, the 
drawback is that one learns about as much about the approach to equilibrium as through the 
linearized Boltzmann equation. More importantly, the notion of gap has other drawbacks and 
this will be explained in the next section. 

5. Entropic approach to equilibrium 

Using the gap as a rate for approach to equilibrium has an obvious drawback. Assume that 
Fq = Ylj=i fj subject to the normalization condition 

/ _ F (v)da {N) = 1 . 

The almost independence of the functions fj yield that 

N 

ll^o(-)ll2«n/ /> (N) = e const - N . 

jJiJsn-HVn) 

Hence, the same is true for ||F — 1|| and, using the gap estimate only, it will take a time of 
order N to relax to the equilibrium distribution. The right quantity to consider is Boltzmann's 
relative entropy 



H(F\a (N) ) := f _ F^hgF^da^ 



l (VN) 

In general if /i, v are two probability measures, their relative entropy is defined by 



H{p\v) = / hloghdu , h = — . 



Thus, if f(v)dv is a probability measure on K. then the relative entropy of /dv with respect 
to the Gaussian function ^y(v) is given by 



H{f\i)= f m log Mdv 
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Note that if F^ is an f(v)dv chaotic family one would expect that 

H(F N \aW) = JVtf(/| 7 ) 

as N — y oo. In other words, the entropy is, like the total energy, an extensive quantity, 
i.e., proportional to N. It has been shown by Boltzmann that H(f\j) decreases in time for 
solutions of the Boltzmann equation. This is the famous H-Theorem. For the Kac equation, 
this can be readily seen since 

^H(f(-,t)\ 1 ) = ^Jf(v,t)\ogf(v,t)dv--^Jf(v,t)\og 1 (v)dv 

* d6p(6) f f [f(v',t)f(w',t) - f(v,t)f(w,t)]logf(v,t)dvdw 

tv Jrjr 



d0p(9) / / [f(v',t)f(w',t) - f(v,t)f(w,t)]log[f(v,t)f(w,t)]dvdw 




d6p(6) / / [f(v',t)f(w',t)-f(v,t)f(w,t)\ 

Jr Jr 

x [log /(«', t)f(w', t) - log f(v, t)f(w, t)] dvdw < 

Note that we have used the fact that the second moment, the kinetic energy, is preserved in 
time to drop the term 

— \ f{v,t) log j(v)dv . 

dt .hi 



This raises immediately the question for the rates of equilibration |22j . Is there an exponential 
rate? One could ask the same question for the Kac master equation, i.e., is it true that 

±H(F(. f t)\aM) < -const.H(F(.,t)\aW) , 

for a constant that is, hopefully, independent of N. This surmise for the Boltzmann equation 
is known as Cercigniani's conjecture. The best result so far is by Cedric Villani [22] who 
proved 



Theorem 5.1 (Villani's Theorem). Let Fq be any probability density on S N ~ 1 (\/N) with 
finite relative entropy H (F (-)\a^) . Then the solution of Kac's master equation with initial 
condition F satisfies 

H{F{-,t)\a w ) < e- CNt H{F {-)\a {N) ) 

where 

r 2 



N-l 

Differentiating H (F(-, t))\a^) with respect to time yields 

d 
dt' 



: H(F(.,t)\aW) = - [ _ [C N F(v,t)]logF(v,t)daW 



The term 

[C N F(v)]\ogF(v)da {N) 
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is called the entropy production. Villani proved that for all densities F, 



/ _ [N(I - Q N )F(v)} log F(v)da( 
Js n - 1 (Vn) 

> ^~r [ F(v)\ogF(v)daW 



IS N - 1 (VN) 

that is, the relative entropy production is bounded by 2/(N — 1). 

Sketch of a proof. The idea is to interpolate densities via the heat kernel on the sphere. Recall 
that 

i<j 

where Lij is an angular momentum operator, i.e., 



Set 

and compute 



L id = Vidj - Vjdi 



F(s) = e As F 



— f F(s) log F(s)da {N) = / AF(s)logF(s)da (iV! 
|VF(s) 



da™ = -4 / \vJFU)\ 2 d<rW 



Define A fc '' by 

Since 

we have that 

and hence 



2 
k,l 



F(s 

A = J2 L h = Ak,l + L 

i<j 

[Li j, A] = and [A fc >',L M ] =0 



e As = e Afe 'V^ s 



e As F(x) = e Ak ' ls [e L t' s F](x) = / G k >\x,y; s)[e L h s F}(y)d^ N \y) , 
where G k,l (x, y\ s) is the kernel associated with the heat semigroup e A ' s . It has the properties 

G k ^x,y,s) > , J G k \x,y-s)d^ N \y) = 1 . 
Set 



FUs) = e L t' s F 



and note that 



lim F kA (s) = P k .,.F 

Since 



"k,i{ s J — r k,V 

s— >oo 



-±J\V^W)\ 2 ^ {N) = -4^T||L MV /F(i)| 2 daW . 



and the function 

F ^ \L k ,JFTs)\ 2 
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is convex, we can use Jensen's inequality to find the lower bound 



k<l 

To summarize, we have shown that 



- 4 E / / ^^ y> s)\L k ^F ktl (y,s)\ 2 d^ N \y)da( N \x) 

k<l 

" 4 E / / GKl ^ J/5 s)d^ N \x)\L k ^F ktl (y,s)\ 2 d^ N \y) 
-AJ2 J \L k ,i^F^7)\ 2 da^ N \y) . 



k<l 



k<l 

or 



-4 f\V^/F{sj\ 2 da^ > -4J2 f\LuyjFu(y,s)\W N \y) 

k<l 

± [ F(s) log F(s)daW > _ 4 £ | \L k ^F k j(y, s)\ 2 da^\y) 

k<l 

= _^f \L k , l F kl (y,s)\ 2 da(N) 
i£J F Kl (y,s) 

Y^^-J F k ,\ogF k M N) ■ 



k<l 

Integrating both sides yields 



k<l 

or 



- f F log Fda™ >J2f Pk > lF lo S P ^ Fdcr{N) ~ I F lo S Fdff(JV) 

- 1 / F log FdaW >J2f Pk > lF lo S p fc,^ d ^ (JV) 
- J k<i "* 

>J2jPk,iFlogFda^ = (*\ JQ N F\ogFda^ 



k<l 

or 

N 

2 



J(I-Q N )F\ogFdaW > _L J FlogFdaW 

from which Villani's theorem follows. □ 

Villani's theorem yields an equilibration time that is again of the order N, since we have 
for all densities F 

([C N F],]ogF) 2 

H(F,aW) -N-l' { } 

This raises the obvious question whether the estimate can be improved. Is there a density Fn 
so that 

r ({C N F N }, log F N ) 

N^oc H(F N , aW) 
The following theorem is proved in ||. 
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Theorem 5.2 (CCLRV). For each c > 0, there is a probability density f on R with 

vf(v)dv = 0,[ v 2 f{v)dv = 1 , 



an f(v)dv chaotic family {F N } NeN such that 

([C N F N {v,t)],hgF N {v,t)} 

hm sup — — — jTTT- < c . 

at^oo H(F N ,aW) 

For each c the density is smooth, bounded and has moments of all order. 

If one considers the Kac equation ( |3|) instead of the master equation, then the intuition 
behind this theorem is not difficult to understand. Denote by j a (v) the normalized Gaussian 
on R centered at the origin of variance a. Now consider the function 

f s (v) = Sji(v) + (1 - 6)j_l(v) 

26 2{l — o) 

where 5 is a small number. The first Gaussian describes an ensemble of a small fraction of 
particles that have almost all of the kinetic energy, whereas the remaining large fraction of 
the particles have very little energy. Intuitively, one expects that it would take a long time for 
such a state to equilibriate. In fact, it is not hard to see that that the entropy production of 
this state is of order —5 log 5, and thus small. With this function fs(v) one can construct a fg 
- chaotic state Fn in the spirit of Theorem |3.3| which has the properties stated in the previous 



theorem. Note that, as 5 shrinks to zero, the fourth moment tends to infinity. Villani [22| 
conjectured that there exists a constant C such that for every N there is F^ with 

,. {[C N F N ], log F N ) C 
n™oo H(F N ,aW) N' 

This conjecture was essentially proved recently by Amit Einav ||. 

Theorem 5.3. For any < (3 < | there exists a constant Cp depending only on (3 such that 

CplogN 

iN - N 1-2P 

The crux of the matter is to make the statement in Theorem |5.2| , the statement about a 
chaotic state and its marginal quantitative. The key theorem is an analog of Theorem |3.4| , 
which can be rendered in a much stronger form since it is a statement about the particular 
function f$(v). 

Theorem 5.4. Let fs N (v) = fs N ( v ) = <^7^_(^) + (1 — ftzv)7 i jv) where 5n is chosen such 

2S N 2(1-S N ) 

that 

5 l N +2 ?.N — > oo ,5^-N -^ . (16) 



TV— >oo N— >oo 



Then for a fixed j 

Zn-j (fs N , yu) 



yW^J-^-l^-^lu^- 1 



/ (u-N+j) 2 \ 

' e 2(N - j)s 's N X 

+ X j {N-j,u 



V27T 

V / 



where sup ueR \\j(N — j, u)\ < £j(N) and limjv-5.00 e i(^) = 0. 
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Theorem |5.3| or rather its proof is an application of the interplay between the Kac equation 
and the Kac Master equation. In this particular instance knowing a state of low entropy 
production for the Kac equation yields a state of low entropy production for the Kac Master 
equation. This connection can be cast as entropic chaos. Let /ibea probability measure on 
R and for each N let /i^ be a probability measure on S N ~ 1 (y/N). The sequence {/i^jjveN 
is said to be entropically ^—chaotic if it is /z-chaotic and in addition 



tf(//W| 



a 



N\ 



l r im 77 = H(fi\n/) 

N— >oo iV 

Theorem 5.5. Let f be a probability density on R satisfying 

f(v)v 2 dv = 1 , / f(v )v A dv < oo , f E L c 



and set fi(dv) = f(v)dv. Then {[n® N } S N-i(^/jj\}Nem is entropically \i-chaotic, in fact for any 
k G N we have 

lirn^H (m^V-WIa*®*) = 

Moreover, let {/^^}jveN be any family of symmetric probability measures on § Ar_1 (VW) with 



±H(pW\bnv-HVK))^°- 



N 
Then {^ n ^}ngn is entropically fi-chaotic. 

For a proof the reader may consult . 

It would be nice to know whether or not it is true that for any entropically chaotic family 
{fx iN) } NeN for any k 

lim H (M k (^ N) )\ix m ) =0. 

This is an open problem. Using a diagonal argument together with the previous theorem one 
obtains 

Corollary 5.6. Let f be a probability density on R with 

[ f(v)v 2 dv = l,H(f\ 1 )<oc. 

Then there exists an f(v)dv -entropically chaotic sequence. 

While exponential entropic decay in time for general initial conditions is false one may ask 
for natural conditions on Fn such that 

(£ N ,\ogF N ) 
H(F N \aW) " C>U 

for some c independent on N. This problem is completely open. One could weaken the above 
question by asking whether there are there natural conditions on / so that one can construct 
a /-chaotic sequence {F N } with 

(C Nl \ogF N ) 

H(F N \aW) " C>U 

for some c independent on iV? Nothing is known about this problem either. 
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